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DISPERSE, AGGREGATE AND DISPERSE (DAD) CONTROL STRATEGY FOR 
MULTIPLE AUTONOMOUS SYSTEMS TO OPTIMIZE RANDOM SEARCH 

ABSTRACT OF THE DISCLOSURE 
A method for conducting a search of an area for targets by 
a number of vehicles. First each of the vehicles randomly 
disperses from the other vehicles. Then during an aggregate 
phase, each vehicle responds in a predesignated way to an 
encounter with one of the other vehicles. A number of specific 
search strategies may be followed which tend to direct the 
search in a particular designated direction or allow a 
successful searching vehicle to set the direction of the search. 
This method results in improved performance in conducting 
searches by robots or other vehicles. 
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3 DISPERSE, AGGREGATE AND DISPERSE (DAD) CONTROL STRATEGY- FOR 


4 MULTIPLE AUTONOMOUS SYSTEMS TO OPTIMIZE RANDOM SEARCH 

5 

6 STATEMENT OF GOVERNMENT INTEREST 

7 The invention described herein may be manufactured and used 

8 by or for the Government of the United States of America for 

9 governmental purposes without the payment of any royalties 
I 10 thereon or therefor. 
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12 BACKGROUND OF THE INVENTION 

13 (1) Field of the Invention 

14 The present invention relates to travel control methods and 

15 in particular to such methods which are used to control search 

16 vehicles . 

17 (2) Brief Description of the Prior Art 

18 When searching an area for an object such as a mine, it is 

19 often desirable to search an area using expendable units. These 

20 units should have a relatively low cost, but they should also be 

21 capable of searching an area in an efficient fashion. 

22 One way of searching an area is by an ordered search 

23 algorithm such as a grid. Grids are not readily adaptable to 




1 

■ r^ough terrain, and the party positioning the search object can 


2 

optimize placement of search objects to reduce grid efficiency. 


3 

Another method of searching an area is by random dispersal. 


4 

Random dispersal requires little % control and accommodates any 


5 

terrain type. The problem with random dispersal is that it is 


6 

inefficient. Some areas go unsearched while other areas are 


7 

subjected to multiple searches. 


8 

Various methods and apparatus are disclosed in the prior 


9 

art for controlling robotic vehicles. 


10 

U.S. Patent No. 5,321,614 to Ashworth, for example, 

i U 

11 

discloses a control apparatus and method for autonomous 

5 : E 
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vehicles. Obstacle sensors onboard each vehicle produce signals 


13 

associated with obstacles used for navigation. 
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U.S. Patent No. 5,329,450 to Onishi discloses a control 

; 
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15 

method for multiple robots in which a central control station 

16 

distributes remaining tasks to robots having no task. 


17 

U.S. Patent No. 5,367,456 to Summerville et al. discloses a 


18 

control system for automatically guided vehicles. A stationary 


19 

control computer schedules the activities of individual robots. 


20 

U.S. Patent No. 5,568,030 to Nishikawa et al. discloses a 


21 

travel control method for a plurality of robots. Each 


22 

destination route is searched for availability prior to being 


23 

used to control a robot's travel path. 
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U.S. Patent No. 5,652,489 to Kawakami discloses a mobile 
robot control system in which each robot emits a signal. The 
signal is used to stop movement of other robots about to 
traverse the same route. 

None of these methods provides a control method using a 
decentralized method of controlling low cost robots. 


The object of this invention is to define a control 
strategy framework that will improve the performance of multiple 
robots when searching an area. This framework builds on a 
random search strategy by introducing two kinds of phases: a 
disperse phase and an aggregate phase. During the disperse 
phase, the vehicles perform a random search, which will result 
in the group dispersing over the search area. During the 
aggregate phase, the vehicles will continue to search, but will 
also communicate with neighbors when they come into 
communication range of each other. This is referred to as an 
"encounter". During an encounter, two vehicles exchange 
information and adjust their headings based on the current 
encounter strategy. The combination of these phases results in 
a group of robots performing a random search enhanced by intra- 
group communication that will provide better group cohesion and 


SUMMARY OF THE INVENTION 
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a more efficient search. The disperse, aggregate, and disperse 
combination is referred to as the DAD-Control Strategy. The 
DAD-Control Strategy framework allows variations in several 
fundamental ways: the duration of each phase, combination of the 
phases, (e . g . , DADAD) , and the selection of encounter strategies 
during the aggregate phases. 

. The present invention comprises a method for conducting a 
search of an area for targets by a plurality of vehicles. First 
each vehicle disperses from the other vehicles. Then during the 
aggregate phase each of the vehicles responds in a predesignated 
way to an encounter with one of the other vehicles. 


Other objects, features and advantages of the present 
invention will become apparent upon reference to the following 
description of the preferred embodiments and to the drawing, 
wherein corresponding reference characters indicate 
corresponding pa-rts in the drawing and wherein: 


FIG. 1' is a schematic drawing illustrating an encounter 
between two vehicles and a detection of a target in a preferred 
embodiment of the method of the present invention; 


BRIEF DESCRIPTION OF THE DRAWINGS 
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FIG. 2 'is a schematic drawing illustrating a preferred 
embodiment of the method of the present invention, referred to 
hereafter as the north strategy; 

FIG. schematic drawing illustrating another 

preferred embodiment of the present invention referred to 
hereafter as the best finder strategy; 

FIGS. 4a and 4b are schematic drawings illustrating another 
preferred embodiment of the present invention referred to 
hereafter as the best finder or north strategy; and 

FIG. ^is^a schematic drawing illustrating still another 


DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 
The underlying philosophy in robot maneuvering logic is to 



1 the efficiency of this simple search scheme by allowing 

2 exchanges of information that will improve the efficiency of the 

3 next move decision logic of the robot. This establishes a 

4 minimal level of connectivity between group members. The 

5 connectivity is established when two members come into range, 

6 recognize each other and establish a communication link long 

7 enough to exchange a pre-determined packet of information. Once 

8 the information is transmitted, the connectivity is terminated. 

9 The proposed control strategy is a combination of two types 

10 of maneuvering phases: a disperse phase and an aggregate phase. 

11 The natural side effect of a group of vehicles performing a 

12 random search is that the vehicles spread out or disperse over 

13 time. The disperse phase produces such an emergent behavior as 

14 each vehicle follows a random search with communication only 

15 present to avoid the other vehicles, and the group disperses 

16 over the search area. The aggregate phase maintains the random 

17 search maneuvering, but then introduces opportunities for two 

18 vehicles to exchange information through encounters, 

19 Information exchange is primarily focused on adjusting the 

20 heading of one or both vehicles based on the encounter strategy. 

21 Other information categories can be investigated along with new 

22 encounter strategies. By running a sequence of disperse, 

23 aggregate and disperse (DAD) phases, the overall performance 

6 



1 should improve because the vehicles remain more concentrated or 

2 guided during the random search phases. 

3 During the disperse phase, a random walk scheme is used. 

4 In this scheme, vehicles can randomly turn from -4 5 degrees to 

5 45 degrees. Vehicles can also advance from 1 to 10 steps 

6 forward. The upper limit of the turn has been tested at ranges 

7 of ±45 degrees, ±90 degrees ±180 degrees. The value can be set 

8 according to the amount of dispersal and overlap for the 

9 particular application. 

10 During the aggregate phase, vehicles also use the random 

11 walk scheme, but also communicate during encounters. An 

12 encounter occurs when vehicles are within a predetermined 

13 encounter distance to each other. This is defined as the 

14 variable encounter zone, which has a constant value of 70 (units 

15 of distance) . The exchange of information is based on the 

16 current encounter strategy. 

17 When two vehicles are within the encounter zone distance 

18 apart, the vehicles exchange information that impacts the 

19 heading of one or both vehicles. An encounter threshold 

20 variable is set that establishes to some degree the frequency 

21 with which vehicles change heading based on an encounter with 

22 the same vehicle. Sensitivity tests were made varying the 

23 encounter threshold variable by values of 0,5 and 10. This 
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1 signifies that two vehicles will not re-encounter for the number 

2 of simulation cycles specified by the encounter threshold after 

3 the initial encounter even if they remain in the encounter zone. 

4 There are different strategies that were tested when two 

5 vehicles encounter one another. These strategies were motivated 

6 by operational requirements in littoral waters and studies of 

7 animal behavior in a foraging scenario. 

8 Referring to FIG. 1, a first vehicle 10 and a second 

9 vehicle 12 are illustrated. Also illustrated are three targets 

10 14, 16 and 18. The first vehicle 10 has a detection range 20 

11 and an encounter zone 22. The second vehicle 12 has a detection 

12 range 24 and an encounter zone 26. A detection occurs when one 

13 of the vehicles, such as vehicle 10 approaches' one of the 

14 targets such as target 14 within the vehicle's detection range 

15 such as detection range 20. An encounter occurs when two 

16 vehicles such as first vehicle 10 and second vehicle 12 approach 

17 within their respective encounter zones 22 and 26. An encounter 

18 consists of a communication between vehicles 10 and 12/ which 

19 may result in adjusting the heading of one or more of the 

20 vehicles, based on one of the strategies described herein. The 

21 encounter threshold will also provide a delay (in simulation 

22 cycles) to avoid re-encountering the same vehicles. 
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A first strategy, the north strategy, uses a preferred 
direction to establish a new heading. In this strategy, upon 
encounter each vehicle's heading is compared to a preferred 
direction heading (i.e., north or 90 degrees) which specifies 
the overall group's heading. The vehicle with the heading 
closest to the preferred direction is used as the new heading 
for the other vehicle. 

By setting the overall group's heading to impact the 
individual's heading adjustment, the group should eventually 
advance in a sweeping motion in the direction of the overall 
group's heading. In addition, following is introduced at a 
small scale when two vehicles encounter and one adapts the 
heading of the other. This creates a short instance of 
following until the follower vehicle again adopts the random 
search scheme. Another net affect should be the consolidating 
of group members in the operational space or at least in 
clusters . 

Referring to FIG. 2, the north strategy is further 
illustrated. In this strategy, the first vehicle 10 has an 
initial heading 28, and the second vehicle 12 has an initial 
heading 30. A comparison of these initial headings 28 and 30 is 
made with the north or preferred direction 32. Since the second 
vehicle 12 has an initial heading 30 which is closer to the 
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1 preferred direction 32 than the initial heading 28 of the first 

2 vehicle 10, the first vehicle 10 changes direction to new 

3 heading 34. The second vehicle 12 remains at its initial 

4 heading 30. 

5 A variation on the north strategy involves switching the 

6 preferred direction when a preselected condition occurs. This 

7 preselected condition can be the elapse of a period of time, the 

8 finding of a predefined number of targets, or the occurrence of 

9 a set number of encounters with other vehicles. This will 

10 result in the overall group moving back to its point of origin. 

11 This strategy is a slight variation on the north strategy, which 

12 would allow a second pass over already explored area. This 

13 variation may compensate for targets that are missed and 

14 supports running multiple passes over the same area. 

15 Another strategy, the best finder strategy, compares the 

16 number of targets found by each vehicle and uses the direction 

17 of the vehicle finding more targets. The heading of the vehicle 

18 with the most targets found is used as the heading for the other 

19 vehicles in the encounter. Based on observations from social 

20 animals, there are members in a group that show higher success 

21 at discovering food, and other members can be seen to mimic the 

22 actions of this best finder. This strategy allows the vehicle 

23 that has found the most targets to influence the heading of the 
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1 second vehicle during an encounter. This could be interpreted 

2 as the best finder leading the second vehicle to a concentration 

3 of targets. This strategy should improve target finding when 

4 the targets have a clustered or patch distribution given 

5 successful exchange between the best finder and second vehicle. 

6 Referring to FIG. 3, the best finder strategy is 

7 illustrated in which the vehicle with the most targets T found 

8 sets the heading for the second vehicle. For purposes of 

9 illustration, the first vehicle 10 has located four targets and 

10 the second vehicle 12 has located six targets. The first 

11 vehicle 10 has an initial heading 36 and the second vehicle 12 

12 has an initial heading 38. The first vehicle 10 has a new 

13 heading 40 which conforms to the initial heading 38 of the 

14 second vehicle 12 since the second vehicle 12 has located more 

15 targets. 

16 Yet another strategy is the best finder or north strategy. 

17 This strategy is a combination the north strategy and the best 

18 finder strategy such that if both vehicles have found no targets 

19 or have the same number of targets, the vehicles use the north 

20 strategy since no one vehicle has out performed the other. If 

21 there is a discrepancy in number of targets between the two 

22 vehicles, the vehicles use the best finder strategy. 
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Referring to FIGS. 4a and 4b, the best finder or north 


2 

strategy is illustrated. In FIG. 4a the first vehicle 10 has an 


3 

initial heading 42 and the second vehicle 12 has an initial 


4 

heading 44 under conditions where the first vehicle 10 has 


5 

located four targets, T=4, and the second vehicle 12 has located 


6 

six targets, T=6. Because the second vehicle 12 has located 


7 

more targets, the first vehicle 10 assumes a new heading 46 that 


8 

conforms to the initial heading 44 of the second vehicle 12. If 


9 

both vehicles have located the same number of targets T, or if 


10 

no targets have been located, FIG. 4b is applicable. In FIG. 
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4b, the first vehicle 10 has an initial heading 48 and the 
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second vehicle 12 has an initial heading 50. Since the initial 
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heading 50 of the second vehicle 12 is closer to the preferred 
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direction or north 52, the first vehicle 10 will assume a new 

15 

heading 54 which conforms to the initial heading of the second 
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vehicle 12. 


17 

The best finder and north strategy is a variation of the 


18 

best finder strategy. The variation consists of setting the 


19 

best finder vehicle's heading to the preferred direction that in 


20 

this case is north 60. The other vehicle receives the best 


21 

finder's heading as its new heading. The motivation for this 


22 

strategy is to introduce some degree of delegating one vehicle's 


23 

actions to another. The vehicle with the most targets found 



1 will send the second vehicle in the same direction since targets 

2 have been found there to continue the local search. The vehicle 

3 with the most targets will continue the global search by heading 

4 in the preferred direction to locate other concentrations of 

5 targets. 

6 Referring to FIG. 5, the best finder and north strategy is 

7 illustrated in which the best finder strategy applies except as 

8 the best finder adjusts its heading to the overall group heading 

9 of north or the preferred direction. In this example, the first 

10 vehicle 10 has located four targets and the second vehicle 12 

11 has located six targets. The first vehicle 10 has an initial 

12 heading 56 and the second vehicle 12 has an initial heading 58. 

13 Since the second vehicle 12 has located more targets T, it 

14 assumes a new heading 60 that is in a preferred direction or 

15 north 62. The first vehicle 10, which has located fewer targets 

16 T, assumes a new heading 64 in the same direction as the initial 

17 heading 58 of the second vehicle 12. 

18 Another strategy concerns varying the vehicle's velocity 

19 based on the search outcome. The logic behind this strategy is 

20 that a vehicle should slow down and make a slow search if it 

21 finds a high ratio of targets to time searched. Otherwise, the 

22 vehicle should increase its velocity to advance to other areas 

23 more rapidly. 
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1 In order to perform this strategy, each vehicle is 

2. preprogrammed with an estimate, E, for the target density in the 

3 search area. This is weighted by a selected estimate weight, 

4 E_wt. Each vehicle has a value for experience, Exp, related to 

5 The number of targets found T, for an elapsed time, t, and 

6 weighted by E__wt, a weighting factor. Velocity, V, can then be 

7 changed in accordance with the following equations, where AV is 

8 the change in velocity: 
T*Exp _wt 


Exp-- 


t 


9 (1) 

AV = (E-Exp)*E_wt 

10 (2) 

11 Using these equations, it was observed that often the velocity, 

12 V, increases rapidly, and the vehicle exits the search area. 

13 Therefore, a maximum velocity can be set in the vehicle so that 

14 the velocity of the vehicle plus the change in velocity is set 

15 to the maximum if the maximum velocity would be exceeded. 

16 Likewise, a minimum velocity can be set if the change in 

17 velocity would bring the velocity below the minimum. 

18 It will be appreciated by those skilled in the art that 

19 this velocity adjusting algorithm can be applied to any of the 

20 previous search strategies. 
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While the present invention has been described in 
connection with the preferred embodiments of the various 
figures, it is to be understood that other similar embodiments 
may be used or modifications and additions may be made to the 
described embodiment for performing the same function of the 
present invention without deviating therefrom. Therefore, the 
present invention should not be limited to any single 
embodiment, but rather construed in breadth and scope in 
accordance with the recitation of the appended claims. 



